Analysis of technologies and resources for multimodal information kiosk for deaf users

This paper presents an analysis of technologies and resources needed for building of a multimodal information kiosk for deaf people. The considered information kiosk will use sign language as main communication means, since it is main language of communication of deaf users. Thus, the sign language synthesis and recognition modules will be main part of the kiosk. Additional modules include lip-reading support for sign language recognition (since sign language is accompanied by lip articulation), touch screen input, and graphical user interface. To design and build the mentioned modules, large amounts of data are needed for training, especially in the case of recognition modules. The information kiosk is intended for use for provididng/gathering information to/from deaf users, such us train connection or communication with authorities.